4 



Document FP2 
Appi No/ 11/889,938 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

Internationa] Bureau 

(43) International Publication Date 
3 May 2001 (03.05.2001) 




PCT 



(10) International f^rblication Number 

WO 01/31833 Al 



(51) International Patent Classification 7 : H04L 1/16, 12/56 

(21) International Application Number: PCT/I LOO/006 84 

(22) International Filing Date: 26 October 2000 (26. 10.2000) 

(25) Filing Language: English 

(26) Publication Language: English 

(30) Priority Data: 

09/429,035 29 October 1 999 (29. 1 0. 1 999) US 

(71) Applicant: ECI TELECOM LTD. [IL/IL]; Hasivim 
Street 30, 49517 Petach-Tikva (IL). 

(72) Inventor: KIDAMBI, Kalyan; 20162 Braeton Bay Ter- 
race, # 202, Ashburn, VA 20147 (US). 

(74) Agent: INGEL, Gil; Eci Telecom LTD., Patent and Trade- 
mark Dept., Hasivim Street 30, 49517 Petach-Tikva (IL). 

(81) Designated States (national): AE, AG, AL, AM, AT AU, 

AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 



CZ (utility model), BE, DE (utility model), DK, DK (utility 
model), DM, DZ. EE, EE (utility model), ES. Fl. F( (utility 
model), GB, GD, GE, GH, GM, HR. HU, ID, IL, IN, IS. 
JR KE, KG. KP, KR. KR (utility model), KZ. LC, LK, LR. 
LS, LT. LU, LV, MA, MD, MG, MK, MN, MW. MX, MZ, 
NO, NZ. PL, PT, RO. RU, SD, SE, SG, SI. SK, SK (utility 
model), SL. TJ, TM. TR. TT, TZ, UA. UG. UZ ; VN, YU, 
ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY. KG, KZ, MD, RU. TJ, TM), European 
patent (AT BE, CH, CY, DE, DK, ES, Fl, FR, GB, GR, IE, 
IT, LU. MC, NL, PT. SE), OAPI patent (BF. BJ, CF, CG, 
CI, CM, GA, GN, GW. ML, MR, NE, SN, TD. TG). 

Published: 

— With international search report. 

— Before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments. 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: METHOD AND SYSTEM FOR DISCARDING AND REGENERATING ACKNOWLEDGMENT PACKETS IN ADSL 
COMMUNICATIONS 



ACKNOWLEDGMENT PACKET FORMAT 



= 1 IP HEADER } 

SiSE *** "~ 



TCP HEADER 





Soure Port Number 


1 


Destination Port Number 




Sequence Number 


Acknowledgment Number 


Header 


Reserved 


URG 


ACK 1 


PSH 


RST 


SYN 


FIN 


Window 


Length 
















Size 




TCP Checksum 




1 




Urgent Pointer 





oo 



O 



(57) Abstract: A method and system for discarding and regenerating transmission control protocol (TCP) acknowledgment packets 
(ACKs) transmitted over an asymmetrical digital subscriber line (ADSL) to increase the data transmission rate. When an incoming 
ACK is received at a first intermediate node located at one end of the ADSL link, the intermediate node determines whether a prior 
ACK from the same connection/flow (TCP receiver) is presently stored in a queue awaiting transmission. If a prior ACK packet is 
not presently stored in the queue, the incoming ACK packet is stored in the queue. However, if there is a prior ACK packet in the 
queue, the information contained in the incoming ACK packet is stored in a per-connection state table and the incoming ACK packet 
is discarded. When the prior ACK packet is ready to be transmitted to a second intermediate node via the ADSL link, the information 
contained in the per-connection state table regarding the discarded incoming ACK is copied into the prior ACK. Upon receiving the 
prior ACK, the second intermediate node regenerates the discarded ACK based on the information contained in the prior ACK. 
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METHOD AND SYSTEM FOR DISCARDING AND REGENERATING 
ACKNOWLEDGMENT PACKETS IN ADSL COMMUNICATIONS 

Field of the Invention 

The present invention relates to a method and system for transmitting data 
packets over an asymmetrical digital subscriber line. More particularly, the present 
invention relates to a method and system for discarding and regenerating transmission 
control protocol (TCP) acknowledgement packets transmitted over an asymmetrical 
digital subscriber line (ADSL) to increase the data transmission rate. 

Background of the Invention 

Digital subscriber line (DSL) technology was developed for use as a 
transmission medium for the Integrated Services Digital Network (ISDN) basic rate 
access channel. Asymmetric DSL (ADSL) offers a variety of Internet access speeds 
over a single twisted pair. Therefore, ADSL holds the highest potential in the DSL 
family to offer inexpensive, broadband access to homes and office in the near term. 
Presently, the primary application for ADSL in Internet traffic employing TCP. A 
very high percentage of Internet traffic is TCP because it is robust in wide variety of 
environments. 

ADSL provides significant increases in bandwidth over existing copper lines 
using the traditional duplex POTS channels, occupying the frequency band between 
300 Hz and 4KHz. ADSL provides a forward transmission channel of 1.5-8 Mbps, 
occupying the frequency band of 100KHz-500KHz, and a reverse transmission 
channel of 64-786 Kbps, occupying the frequency band of 1-KHz to 50KHz. ADSL 
has bandwidth asymmetry rather than latency asymmetry since the propagation delay 
is quite negligible. An ADSL line is for exclusive use of the subscriber, with no 
contention for bandwidth on the local loop. 

The asymmetric nature of ADSL adversely affects the performance of TCP 
because TCP throughput is regulated and limited by the flow of acknowledgments 
(referred to as the "ACK clock") generated by the receiver in response to received 
data packets. In particular, TCP steady data transmission is dependent upon 
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acknowledgment packets (ACKs) having the same time spacing all the way back to 
wade* Qnee the A<fe reach feMfeWWfiia&n ^ti*n^ked out with 
the same spacing. With ADSL, bandwidth asymmetry affects the performance of 
TCP because it relies on timely feedback from the receiver to make steady progress 
and fully utilize the available bandwidth in the forward direction. Therefore, any 
disruption in the feedback process impairs the performance of the forward direction 
data transfer. Further, a low bandwidth acknowledgement path could significantly 
slow the growth of the TCP window at the sender side, and make the data 
transmission speeds independent of the link rate. 

As discussed in "Window-based Error Recovery and Flow Control With a 
Slow Acknowledgment Channel: A Study of TCP/IP Performance", Proceedings of 
INFOCOM 1997, April 1997 by T.V. Lakshman et al. (Lakshman), the impact of 
asymmetry on TCP/IP performance can be characterized using an index called 
normalized bandwidth ratio (k) which is the ratio of raw bandwidths on both 
directions to the ratio of packet sizes in both directions. When k is greater than one, 
the TCP throughput on the forward channel is restricted to a maximum of (forward 
channel bandwidth)/k. In other words, if the reverse channel is saturated at k 
acknowledgements/second without any acknowledgement suppression, the forward 
channel can send at a rate of k packets per second (if the window is constant), or else 
it is 2k packets per second (assuming two packets are sent for every ACK). This can 
be generalized into a model which is called the AMP model and can be used to guide 
the study of both unidirectional and bi-directional transfers. Other factors like bi- 
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directional traffic (e.g., downloading a web page while sending an email) or protocol 
overhead (e.g., PPPoE, PPTP, ATM, etc.y^ 

the asymmetry problem. 

It has been shown in "The Effects of Asymmetry on TCP Performance ACM 
5 Mobile Networks and Application Journal, by Balakrishnan et al. (to appear) and in 
U.S. Patent 5,5793,768 (Keshav), that performance can be substantially increased by 
making two key changes: simply suppressing acknowledgements on the reverse 
channel (ACK- filtering), and regenerating them after the reverse link has been 
traversed (ACK-reconstruction). Balakrishnan et al. also apply the same techniques to 

10 address types of asymmetry other than bandwidth asymmetry, including asymmetry in 
delay, loss rates, and so on. These techniques can be classified as "ACK-regulation 
techniques" since they are very different from mechanisms like Random Early Drop 
(RED) because the latter are designed to drop packets, not ACKs, and are used to 
signal congestion to TCP, not to alleviate asymmetry problems. 

1 5 Balakrishnan et al. disclose an "ACK-filtering" method wherein when a new 

ACK enters the queue device, the queue is checked for previous ACKs from the same 
flow. If previous ACKs are located in the queue, some or ail of the of the previous 
acknowledgments are cleared or discarded and the latest acknowledgment is enqueued 
at the tail of the queue. The goal is partially to free some space in the queue for other 

20 data packets and ACKs, and partially to compress the ACK information. There is no 
per-flow state, or multiple queues, but there is overhead in linearly searching the 
queue for ACKs. Balakrishnan et al. disclose that in some cases ACK filtering alone 
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provides either insufficient compensation for asymmetry or even degrades 
p^nnance, necessit^mg 

(ACC), which involves TCP modification, and/or ACKs-first (priority) scheduling for 
compensation. This is because of the delays in sending out ACK information which 
5 might interact with timeouts. 

Keshav discloses an "ACK-collapsing" method wherein all ACKs are 
enqueued, but at the transmission opportunity, the ACK received latest in time is sent 
and all other ACKs in the queue are dropped. Several ways of implementing this idea 
are possible (e.g., using separate ACK queues, or queueing ACKs in a LIFO manner, 

1 0 or with a single queue, searching the queue for the latest ACK when there is a 
transmission opportunity for the connection). 

Figure 1 shows a schematic block diagram of a conventional TCP network 
comprising an ADSL link 3 which is terminated on either end by a remote end ADSL 
transceiver unit (ATU-R) device 2 located at a customer premises (e.g., a modem) and 

1 5 a central end ADSL transceiver unit (ATU-C) device 4 located at a telephone 

company central office. The ADSL link 3 has a bandwidth of 8 Mbps in the forward 
link, and 64 Kbps to 784 Kbps in the reverse link. The ATU-C device 4 functions are 
assumed to be implemented inside a DSL access multiplexer (DSLAM)- Data packets 
are transmitted from a TCP data source, such as the Internet 6, using a network device 

20 or router 5. The router 5 transmits the data packets to the ATU-C device (DSLAM) 
30 over a 155 Mbps link. The ATU-R device 2 is connected to a TCP destination or 
computer 1 via a 10 Mbps switched Ethernet link. The interface to the computer 1 is 
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often though the point-to-point protocol over Ethernet (PPPoE) standard which allows 
the ttvetVtag Ktmmna Wmte WlileK may Be P^instaBed m computers. Further, 
multiple computers 1 may be connected through the Ethernet to the ATU-R device 40. 
In the case of multiple TCP sources (not shown), each source would have a 
5 corresponding dedicated 10 Mbps link to the router 5. 

Several problems arise due to the constrained reverse link of the ADSL link. 
An example of this is a user downloading data from a server. To facilitate 
understanding of the problem, the following discussion is restricted to single source 
transfer with reference to Table 1 illustrating unidirectional single flow simulation. 

1 0 When the queue buffer size is infinite, the forward throughput is restricted to less then 
75% of the full throughput. Further, it can be seen that the effect of asymmetry 
decreases when the reverse link bandwidth is increased. TCP enters into the 
congestion avoidance stage in the time limit of 0 to 7 seconds. Moreover, TCP after 
some time of simulation a point of saturation where the number of data packets 

1 5 generated in response to a single ACK is only two. 



TABLE 1 



Forward/Reverse 
Speeds 


Throughput 
(Mbps) 


Average 
Queue 


Simulation 
Time (seconds) 


K 


8Mbps/64Kbps 


2.51 


0.03 


6 


5 


8Mbps/128Kbps 


3.85 


0.03 


6 


2.5 


8Mbps/64Kbps 


1.52 


0 


20 
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8Mbps/128Kbps 


3.01 
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20 


2.5 


8Mbps/256Kbps 


5.98 
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20 


1.25 


8Mbps/640Kbps 


7.46 
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20 


0.5 


8Mbps/784Kbps 


7.46 


0.8 


20 


0.41 
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Therefore, it is an object of the present invention to solve the problem of 
fSmmmm ADSL revefse liiifc saturation. 

Summary of the Invention 

5 In accordance with the present invention, a communication method and system 

are provided for a TCP network having an ADSL link wherein acknowledgment 
packets (ACKs) are dropped at one end of an ADSL reverse link and are regenerated 
at the other end of the ADSL reverse link to increase throughput on both the ADSL 
forward and reverse links. In particular, when an incoming ACK is received at an 

10 ATU-R device located at one end of the ADSL link, the ATU-R device determines 
whether a prior ACK from the same connection/flow (TCP receiver) is presently 
stored in a queue awaiting transmission. If a prior ACK packet is not presently stored 
in the queue, then the incoming ACK packet is stored in the queue for transmission to 
an ATU-C device located on the other end of the ADSL link. However, if there is a 

15 prior ACK packet in the queue, then the information contained in the incoming ACK 
packet (the ACK packet that is generated latest in time) is stored in a per- flow state 
table at the ATU-R device and the incoming ACK packet is discarded. When the 
prior ACK packet is ready to be transmitted to the ATU-C device via the ADSL link, 
the information contained in the per-connection state table regarding the discarded 

20 incoming ACK is copied into the prior ACK so that the prior ACK acknowledges all 
of the data which the discarded ACK should acknowledge. 



6 
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Upon receiving the prior ACK, the ATU-C device may regenerate the 
l ACK based on the information contained in the prior ACK such as the 
number of discarded ACK packets and a connection identifier encoded in a special 
field within the ACK. The ATU-C device also maintains a per-connection state table 
5 which contains information regarding the latest ACK sequence number belonging to 
each connection. Further, a regeneration factor is introduced which denotes the 
number of discarded ACKs regenerated in response to one ACK. 

The prefen-ed embodiment of the present invention has as its object the 
suppression of as many ACKs in the reverse channel as possible. In this manner, the 
10 preferred embodiment of the present invention takes advantage of the fact that TCP 
ACKs are cumulative and ensures an acknowledgment packet of a connection in the 
queue of the ATU-R device. An ACK which leaves the queue acknowledges all the 
data which the latest ACK coming into queue should acknowledge. Further, per- 
connection information is maintained so that it guarantees one ACK per-connection to 
1 5 be sent back to the ATU-C device. As a result, a buffer size of only N ACKs is 
required where N is the number of active flows, assuming separate packet buffers. 

Brief Description of the Drawings 

A preferred embodiment of the present invention is described in detail below 
20 with reference to the attached drawing figures, in which: 

Figure 1 is a diagram illustrating a conventional TCP network; 
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Figure 2 is a flowchart illustrating an ACK discarding method in accordance 




: of the present invention; 



10 



15 



Figure 3 illustrates the format of an ACK packet and a TCP header; 

Figure 4 illustrates the format of a per-connection state table in accordance 
with the preferred embodiment of the present invention; and 

Figure 5 is a flowchart illustrating an ACK regeneration method in accordance 
with a preferred embodiment of the present invention. 

Detailed Description of the Preferred Embodiment 

Forward throughput for one-way transfer using TCP follows the "AMP" 
model where A is the ACK transmission rate, M is the multiplication factor (packets 
generated for each ACK received) and P is the ACK packet size. That is, the fraction 
of the reverse link allocated to ACK traffic is saturated at A ACKs/second, each ACK 
generates M packets on the average (M = multiplicative factor), due to the effects of 
TCP dynamics and ACK-regulation schemes working together, and the average size 
of packets is P bits/packet. If the forward link capacity allocated to packets 
corresponding to these ACKs is F bits/second, then the forward link throughput over 
the observation period is limited to Min (F, A*M*P) bits/second. Since the ACK rate 
A is fixed, the only variables are M and packet size P. 

As discussed earlier, Lakshman's normalized bandwidth ratio "k" 
characterizes an absolute upper bound on the forward throughput based upon link 
bandwidths and packet vs. ACK sizes. The AMP expression, on the other hand, is an 
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operational bound achievable with the asymmetric channel augmented with ACK- 
reguiation schemes. In particular, if the ACK-regulation components can achieve a 
maximum average multiplicative factor of M, then the AMP expression is a tighter 
bound on the achievable forward throughput. Moreover, it also accounts for 
5 scheduling allocations to ACKs and corresponding packets and vice versa (in the 
definition of F and A), and can hence be useful in understanding effects of bi- 
directional traffic. 

For example, assuming that the reverse link speed is 64 kbps, the forward link 
speed is 8 Mbps (the forward link is fully allocated to carry packet traffic, and the 

10 reverse link to carry ACK traffic), packet size is 1000 bytes, ACK size = 40 bytes, 
TCP is in its slow start phase (generating two packets per ACK) and no ACK- 
regulation schemes are used. The ACK rate (A) would be 200 ACKs/second , the 
multiplicative factor M=2, and P = 8000 bits, and the maximum throughput limit on 
the forward link = Min (8 Mbps, 3.2 Mbps) - 3.2 Mbps. It should be noted that the 

1 5 number of TCP flows sharing the ADSL link is immaterial in this model because it 
should be captured in the specification of M. In particular, in this case if the TCP 
sources are all in congestion avoidance (and not in slow start), then M is closer to 1, 
and limit is even lower (about 1.6 Mbps). 

The AMP model is also useful in analyzing the bi-directional traffic case, 

20 especially when link-sharing schemes like class based queueing (CBQ) are deployed. 
Specifically, it can be assumed that in each direction, there are two classes (queues) 
served by CBQ: one for packets and one for ACKs. It is further assumed that packets 

9 
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one 



on the forward link get a fraction f (1 > f > 0) of the forward link capacity (C f ), and on 
m revise link get a -SKi^-g (1 >■ g > d) of -the' rmrse^iiidc edacity (C r ). " Lifik 
capacities are expressed in bits/second. ACKs, therefore, get fractions 1-f and 1-g of 
the capacity of the forward and reverse links, respectively. Unused capacity of 
5 class may be used by the other class. 

The AMP model can be applied to the system as follows, assuming that P 
the size of ACKs in bits/ACK and for simplicity, that the reverse channel (both 
packets and ACKs) is saturated at their respective scheduling shares. The bounds on 
the maximum rates of packets and ACKs in both directions are given in the following 
10 table: 



■ ack 



IS 





Max Packet Rate (pkts/s) 


Max ACK Rate (ACKs/s) 


Reverse Channel 


g* C r /P (saturated) 


(1-g)* C r /Pack (saturated) 


Forward Channel 


Min[(l-g)C r M/Pack, f*C f /P] 


Min[ f*C f /P ack ,g* C r /P] 



The reverse ACK rate is therefore (1-g)* C r /Pack ACKs/s, which can 
generate a maximum packet rate of Min[(l-g) C r M/Pack, f*C f /P] in the forward 

1 5 direction. For the above saturation assumption to hold, it is necessary that the forward 
packet rate is not saturated, i.e., (1-g) C r M/Pack <= f*C f /P. Given that both M and g 
can vary on the LHS of the inequality, the fraction f should be set large enough to 
accommodate the maximum of the product (M* (1-g)). Moreover, the maximum 
possible ACK rate on the forward channel corresponding to any packet rate on the 

20 reverse channel is expected to be small for any asymmetric channel. For example, 
even if the reverse channel is 640 kbps (k = 0.5) and all of it was allocated to packets, 



10 
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the ACK rate on the forward channel is 25.6 kbps, less than 0.33% of an 8 Mbps 
ffimwclXffik. TfiefefiSre, f (the link fraction allocated to packets on the forward link) 
should be chosen to be large, and can be as large as 99% for pure TCP/IP bi- 
directional traffic. 

5 The choice of g, however, is partly a policy issue regarding the minimum 

bandwidth provided to long flows, and partly a performance issue regarding the under 
utilization of the forward link capacity. If M could increase dynamically to perfectly 
compensate for the decrease in ACK rate A due to increase in reverse packet traffic, 
then the performance issue mentioned above disappears. However, M is limited 

10 primarily due to dynamics of TCP, especially congestion avoidance, even if ACK 

regulation schemes could dynamically adapt to increases in reverse packet traffic. In 
particular, if the normalized bandwidth ratio k, measured in terms of link shares of 
ACKs and packets on both directions, increases beyond 10, ACK regulation schemes 
cannot provide sufficient compensation. Therefore, the choice of g (the link fraction 

1 5 allocated to packets on the reverse link) is a tradeoff between performance and policy 
considerations. 

The preferred embodiment of the present invention seeks to suppress as many 
ACKs in the reverse channel as possible. In this manner, the preferred embodiment 
of the present invention ensures an ACK of a connection in the queue of the ATU-R 
20 device 2 and takes advantage of the fact that TCP ACKs are cumulative. An ACK 

packet which leaves the queue acknowledges all the data which the latest ACK packet 
coming into queue should acknowledge. Further, per-connection information is 
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maintained so that it guarantees one ACK per-connection to be sent back to the other 

In the preferred embodiment, when an incoming ACK from the TCP receiver 
is received at the ATU-R device 2, it is determined whether an ACK from the same 
5 connection or destination is presently stored in the queue awaiting transmission. A 
first-in-first-out (FIFO) queue is utilized for storing ACKs (and optionally packets, as 
discussed later). Unlike U.S. Patent No. 5,793,768 (Keshav), the preferred 
embodiment utilizes a minimal per-flow state to avoid enqueuing ACKs which are 
going to be dropped anyway. In this manner, a queue size of only N ACKs is 
10 required, where N is the number of active flows/connections assuming separate packet 
buffers. 

In particular, with reference to Figure 2, when a data unit is received by the 
ATU-R device 2 from the TCP destination 1, the ATU-R device 2 first must 
determine whether the data unit is an ACK (step 1 1). If the incoming data unit is 

1 5 determined to be an ACK, the connection or session ID of the incoming ACK is then 
identified by checking the source port number, the destination port number, the source 
address and the destination address in a TCP header of the incoming ACK (step 12). 
Figure 3 illustrates the format of an ACK packet and a TCP header. The connection 
of the . incoming ACK as identified by the TCP header is then used to determine if per- 

20 flow information regarding the connection of the ACK is stored in a hash or per- 
connection state table at the CPE device (step 13). As shown in Figure 4, the per- 
connection state table includes a flag consisting of a single per-flow or active bit 
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which indicates if an ACK of that flow exists in the queue, and the latest ACK 
sequeB©© number seen from that flow. If the comecfion of the incoming ACK is 
represented in the per-connection state table, the active bit is checked to determine if a 
prior ACK from the same destination is presently stored in the queue (step 14). If the 
5 active bit is zero, the ACK is stored in the queue, the active bit is set to " 1 " and the 
ACK sequence number is copied into the per-connection state table (step 17). If the 
active bit is already set upon receipt of a non-duplicate ACK, then the ACK sequence 
number in the per-connection state table is updated to this value, the ACK is discarded 
, and an ACK drop counter at the ATU-R device 2 is incremented (step 16). On the 

1 0 other hand, if the connection of the ACK is not represented in the per-connection state 
table, a new entry is created for the connection of the incoming ACK which includes 
the source port number, the destination port number, the source address and the 
destination address from the header of the incoming ACK (step 15). The ACK 
sequence number is then copied into the per-connection state table, the active bit is 

1 5 set, and the incoming ACK is stored in the queue (step 1 7). 

When an ACK is dequeued for transmission from the ATU-R device 2 to the 
ATU-C device 4 via the ADSL link 3, the latest value of ACK sequence number from 
the per-connection state table is copied to the header (header checksum adjusted) of 
the outgoing ACK and the number of ACKs being dropped as indicated by the ACK 
20 drop counter is encoded into the ACK header. Further, the active bit in the per- 
connection state table is cleared and the ACK drop counter is reset. It should be noted 
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that ACK processing complexity is O(l) since the hash table is searched rather than 
. the FJEQ queue. 

It is assumed that ACKs are not dropped anywhere else. However, in the case 
of duplicate ACKs, the exact number of the duplicate ACKs generated is used by TCP 
5 in a fast recovery procedure. Therefore, there are two options: either send the same 
number of duplicate ACKs in the reverse channel, or have a regeneration component 
which regenerates the correct number of duplicate ACKs. To achieve the former goal, 
an additional field can be provided in the per-connection state table (which defaults to 
zero) which counts the number of duplicate ACKs ("dup-ACK count") which have 

10 been suppressed. This allows the right number of duplicate ACKs to be transmitted. 
Specifically, when an opportunity arises, all of the duplicate ACKs thus encoded can 
be transmitted before dequeueing the next ACK, and as each duplicate ACK is being 
transmitted, the dup-ACK count in the table can be decremented by one until it 
reaches zero. Note that this allows the dup-ACK count to increase even as duplicate 

15 ACKs are being transmitted. The per- flow bit is set to zero only after transmitting all 
duplicate ACKs. Alternatively, if the number of duplicate ACKs can be encoded 
inside some protocol header, then a component on the other side of the link can 
regenerate the same number of duplicate ACKs without needing them to be explicitly 
transmitted on the reverse channel. 

20 The AMP model discussed above, in conjunction with a knowledge of TCP 

dynamics, facilitates an understanding of the advantages of the present invention. If 
A and P in the AMP model are assumed to be constant, then the ACK dropping 
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method of the preferred embodiment impacts only M in the AMP model, and this 
effect is afeo MgMr^^ 

TCP uses an adaptive window to send packets into the network. If the window 
remained fixed, or changed very little (as in the TCP congestion avoidance phase), the 
5 forward throughput is almost constant at W/RTT, assuming RTT is constant. In this 
situation, suppose m ACKs (m < W) are suppressed for every ACK transmitted on 
the reverse channel (assuming every new ACK acknowledges one new segment). The 
source would receive one ACK for every m packets it transmitted, and transmit m 
packets for eveiy ACK received. But since the window is fixed, the transmission rate 

1 0 would not exceed W/RTT. Therefore, the impact of the ACK discarding method of 
the preferred embodiment is to use the reverse channel capacity of A ACKs/s to 
support a maximum forward rate (as given by the AMP model) of Min[m*A, W/RTT] 
packets/s. Note, that since TCP increases the window by 1/W per ACK received 
during congestion avoidance, the window increase during an RTT is 1/m, because the 

1 5 number of ACKs per-RTT has reduced from W to W/m. 

When the contending TCP flows are all in the slow start phase, each ACK 
reaching the 

TCP source results in (m + 1) segments being sent, where m is the number of ACKs 
suppressed. This is because TCP sends one new packet for every segment 
20 acknowledged (m segments are acknowledged in this case) and one additional new 
packet for increasing the window by one segment. If m is a constant, the 
instantaneous maximum forward rate (as given by the AMP model) is Min[(m+1)*A, 
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W/RTT] packets/s, where Wis also a variable. In reality, m is a random number. 

arbitrarily large depending upon W, and provided the flows remain in slow start. Note 
that, since TCP increases the window by one segment for every ACK received, the 
5 rate of increase of TCP windows is reduced from doubling per RTT (factor of 2) to a 
factor of (1 + W/m) per RTT, because the number of ACKs per RTT has reduced from 
W to W/m. 

Referring back at the AMP model, the multiplicative factor M can be closely 
approximated as the mean of instantaneous values of (m+1) during slow start, and 

10 values of m during congestion avoidance or constant window. In fact, if the TCP 
sources system remains in slow start phase, the AMP model predicts that the ACK 
discarding method of the preferred embodiment can compensate for arbitrary degrees 
of asymmetry (i.e. any finite k). However, since most TCPs reach congestion 
avoidance within a few RTTs, the multiplicative factor saturates at the value of (near- 

15 constant) m seen during the congestion avoidance. In other words, any measurement 
sample of m (number of ACKs suppressed per ACK transmitted) during congestion 
avoidance phase will be a good upper bound of M for the entire observation period. 
This also implies that a higher initial value of SSTHRESH can lead to a higher M 
because the system saturates at a higher window (and m) value. Alternatively, if 

20 SSTHRESH (or socket buffer size) is small, then they have the most dominant effect 
on performance because M saturates. 
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Further, the probability of negative interactions with RTT estimation is greatly 

First, negative interactions with TCP timeouts occur when there is a possibility of 
unbounded or large queueing delays compared to the TCP source's current estimate of 
5 RTT. Second, the ACK dropping method of the preferred embodiment bounds the 
maximum queueing delay (time between enqueue and dequeue of any particular 
ACK) at the controlled queue to be N/A seconds, where N is number of contending 
flows and A is the ACK transmission rate in units of ACKs/second. There will be a 
low probability of negative interactions as long as N/A is relatively small compared 

10 to the smallest RTT estimate of the source. 

Besides the positive effects of reduced ACK buffer size on the reverse link, 
and increased M in the AMP model, the ACK dropping method of the preferred 
embodiment also has negative effects, some of which can be compensated for. First, 
the suppression of ACKs causes a burst of m (or m+1) packets to be sent to the TCPs 

15 for every ACK. The variation in m determines the maximum queue size on the 

forward direction. However, a reasonable buffer size can compensate for this and is 
recommended to avoid interactions due to packet losses. Secondly, the rate of increase 
of TCP window size is limited to factors of (1+ W/m) and (1+ 1/m) during slow start 
and congestion avoidance, respectively (as measured over an RTT). Further, the ACK 

20 dropping method of the preferred embodiment requires access to write TCP headers 
and cannot work under EPSec authentication/encryption, whereas the other schemes 
(e.g., Keshav and Balakrishnan et al.) can function under authentication, but not 
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under encryption because they require only read-access to TCP headers. Finally, the 

*9ppa^ embodiment tiMs to process ACKs both 

during enqueue and dequeue operations, whereas the methods Keshav and 
Balakrishnan et al. schemes require ACK processing during only one of these 
5 operations. 

The burstiness and window increase rate problems can be alleviated using an 
acknowledgement regeneration/reconstruction (AR) component at the end of the 
reverse link. The regeneration scheme would regenerate (and optionally smooth out) 
ACKs suppressed at the ATU-R device. In fact, the regenerator could regenerate 

10 more than one ACK per maximum segment size (MSS), which can be quantified as 
the "regeneration factor" R, all the way up to one ACK for every byte acknowledged. 
The rate of TCP window increase for a round trip time (RTT) is now modified to a 
factor of Min(l+R, 1 +W/m) during slow start and a factor of (1-hR/W) during 
congestion avoidance, at the cost of (R-1)*W excess ACKs per RTT. Given this huge 

15 cost, using a regeneration factor R < 4 is recommended. Immediately, it should be 
noted that if the system remains primarily in congestion avoidance, AR would result 
in m to increase by a factor of (1+R/W) every RTT. If R (< 4) is much smaller than 
W, AR has only a small additional impact in compensating for asymmetry. In other 
words, the ACK dropping method of the preferred embodiment should be viewed as 

20 the primary asymmetry compensation technique. 

The ACK regeneration method of the preferred embodiment of the present 
invention will be described with reference to Figure 5. When an ACK is received by 
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the ATU-C device 4 via the ADSL link 2, the ATU-C device 4 may regenerate the 
-fliniB! ACKCsJiaSea mm information conta&ed in the (prior) ACK packet and a 
per-flow state table maintained at the ATU-C device 4. The per-connection state 
table at the ATU-C device 4 is similar to that of the ATU-R device 2 except that it 
5 comprises a field for storing the latest ACK sequence number in place of the active 
bit. In particular, if it is determined that a received data unit is an incoming ACK, the 
ATU-C device 4 decodes the TCP header of the incoming ACK to determine the 
connection or session ED of the incoming ACK by checking the source port number, 
the destination port number, the source address and the destination address in the TCP 

1 0 header of the incoming ACK, and the number of ACKs discarded at the ATU-R 
device 2 (steps 21 and 22). The ACK sequence number in the TCP header of the 
incoming ACK is copied into the latest ACK sequence number field of the per- 
connection state table (step 23). If the connection of the incoming ACK is 
represented in the per-connection state table, then the ATU-C device 4 determines the 

1 5 number of ACKs to be regenerated based on the latest ACK sequence number stored 
in the state table and the number of ACKs dropped at the ATU-R device 2 stored in 
the header of the incoming ACK (step 25). The discarded ACKs as well as the 
incoming ACK are then regenerated and transmitted to the downstream node and the 
incoming ACK is discarded (step 27). If the connection of the incoming ACK is not 

20 represented in the state table, a new entry is created wherein the connection identifier 
information and ACK sequence number are recorded and the incoming ACK is 
transmitted to the downstream node (step 26). Further, a regeneration factor is 
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introduced which denotes the number of discarded ACKs regenerated in response to 
one received ACK. 

Simulations have shown that the forward throughput increases with an 
increase in the regeneration factor but that it reaches a maximum level when the 
5 regeneration factor is three. Any further increase in the regeneration factor is not 
helpful. The case when regeneration factor is one means the number of ACKs 
dropped are regenerated. The throughput achieved by using ACK regeneration in 
conjunction with the ACK discarding method of the preferred embodiment differs 
from the throughput achieved by the ACK discarding method of the preferred 
10 embodiment alone because of the difference in the number of ACKs reaching the 
source. The window available for the source to send the data is more in case of the 
regeneration factor -1 then of the ACK discarding preferred embodiment of the 
present invention. 

Although the present invention has been shown and described with respect to 
1 5 preferred embodiment, various changes and modifications within the scope of the 
invention will readily occur to those skilled in the art. 
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What is claimed is: 

1 . A method of communicating acknowledgment packets over an 
asymmetrical digital subscriber line, comprising: 
5 generating a plurality of acknowledgment packets at a destination node in 

response to receiving data generated by a source node; 

sequentially transmitting said acknowledgment packets from said destination 

node; 

receiving a first one of said acknowledgment packets at a first intermediate 

1 0 node; 

storing said first one of said acknowledgment packets in a queue at said first 
intermediate node; 

receiving a second one of said acknowledgment packets at said first 
intermediate node while said first one of said acknowledgment packets is stored in 
15 said queue; 

copying information contained in said second one of said acknowledgment 
packets into a data table at said first intermediate node; 

discarding said second one of said acknowledgment packets at said first 
intermediate node; and 
20 copying said information contained in said second one of said 

acknowledgment packets data from said data table into said first one of said 
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acknowledgment packets and transmitting said first one of said acknowledgment 
paclcgfg ©bin Mid first intertftediate node. 

2. The method according to claim 1, further comprising the steps of: 
receiving said first one of said acknowledgment packets at a second 

intermediate node (DSLAM); 

regenerating said second one of said acknowledgment packets based on said 
information copied into said first one of said packets at said second intermediate node; 
and 

sequentially transmitting said first one of said acknowledgment packets and 
said second one of said acknowledgment packets from said second intermediate node 
to said source node. 

3. The method according to claim 1, wherein said information copied into 
15 said first one of said acknowledgment packets comprises the number of 

acknowledgment packets dropped at said first intermediate node and a connection 
identifier. 

4. The method according to claim 2, wherein said regenerating step 

20 further comprises generating a new acknowledgment packet which replaces said first 
one of said acknowledgment packets. 
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transmitting said first and third acknowledgment packets from said second 
tnt^fttfrediate n@de. 

1 1 . The method according to claim 4, wherein in said queue comprises a 
5 first- in- first-out (FIFO) buffer memory. 

12. A communications apparatus for transmitting data over an 
asymmetrical communications link, the apparatus comprising: 

a source node for generating and transmitting a plurality of data packets; 
10 a first intermediate node for receiving said data packets from said source node 

and transmitting said data packets over an asymmetrical communications link; 

a second intermediate node for receiving said data packets from said first 
intermediate node and transmitting said data packets, said second intermediate node 
comprising a queue and a state table; and 
15 a destination node for receiving said data packets from said second 

intermediate node and generating a plurality of acknowledgment packets in response 
to receiving said data packets transmitted by a source node; 

said second intermediate node receiving said acknowledgment packets, storing 
said acknowledgment packets in said queue and transmitting said acknowledgment 
20 packets stored in said queue, wherein each time said second intermediate receives one 
of said acknowledgement packets, said second intermediate node stores said one of 
said acknowledgment packets in said queue if a prior one of said acknowledgment 
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packet is not presently stored in said queue, and copies information contained in said 

om Qf mi m^y^l^^mt pm^m mm sma tafrie ^ MHant of said 

acknowledgment packets if said prior one of said acknowledgment packets is 
presently stored in said queue. 

5 

13. The apparatus according to claim 12, wherein said second intermediate 
node copies said information contained in said one of said one of said 
acknowledgment packets from said state table into said prior one of said 
acknowledgment packets and transmits said prior one of said acknowledgment 
10 packets. 



14. The apparatus according to claim 13, wherein said first intermediates 
node receives said acknowledgment packets from said second intermediate node, and 
regenerates said acknowledgment packets which where discarded by said second 
15 intermediate node based on said information copied into said acknowledgment 
packets from said state table by said second intermediate node. 



15. The apparatus according to claim 12, wherein in said queue comprises 
a first-in-first-out (FIFO) buffer memory. 

20 
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FIGURE 5 
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